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1.  Introduction 


The  United  States  military  is  a  major  employer  of  telemetry  systems  for  test  and 
evalnation  pnrposes.  Snch  systems  typically  format  data  from  varions  sensors,  snch  as 
accelerometers,  magnetometers,  and  global  positioning  system  (GPS),  into  frames  which 
are  then  transmitted  from  the  projectile  or  moving  body  to  a  gronnd  station.  The  sensor 
readings  may  be  sampled  and  qnantized  for  digital  transmission.  In  practice,  the  test  and 
evalnation  commnnity  nses  legacy  pnlse  code  modnlation/freqnency  modnlation 
(PCM/FM)  systems  {1,2)  withont  any  channel  coding.  While  this  commnnications  system 
may  not  be  optimal,  it  is  a  proven  telemetry  standard.  As  a  result  of  such  a  system, 
telemetry  data  are  prone  to  bit  errors  that  must  be  addressed. 

To  add  redundancy,  multiple  receivers  are  used,  which  connect  to  antennas  that  cover 
different  portions  of  the  projectile  flight.  This  helps  to  compensate  for  problems  that  an 
individual  receiver  may  experience.  Multiple  receivers  result  in  multiple  sources  of  the 
telemetry  data.  It  is  therefore  desirable  to  combine  the  multiple  data  hies  into  one  master 
hie  that  represents  the  best  possible  combination  of  the  data.  This  results  in  many 
challenging  signal  processing  problems  which  this  report  addresses. 

The  hrst  problem  associated  with  combining  telemetry  data  from  multiple  sources  is 
identifying  the  same  data  across  different  sources.  A  receiver  will  use  a  time  source  to 
stamp  each  frame  with  the  time  when  it  was  received.  Because  of  the  ambiguity  associated 
with  these  times,  a  periodic  counter  is  included  within  a  frame  to  help  identify  that  frame 
across  multiple  sources.  Section  2  discusses  how  this  identihcation  is  made. 

Once  multiple  sources  are  identihed  as  having  the  same  frame  of  data,  it  must  be  decided 
which  source  of  data  to  use  for  each  word  in  the  master.  Since  oversampling  is  largely 
employed,  the  correlation  between  successive  samples  is  used  in  determining  which  source 
contains  the  best  data.  This  method  is  explained  in  section  3. 

Even  with  multiple  sources  for  a  word,  the  hnal  choice  for  the  master  word  may  still  be 
corrupted  by  noise.  Bit  errors  introduced  by  wireless  channels  result  in  unusual  discrete 
noise  densities  that  depend  on  the  number  of  bit  differences  between  the  transmitted  and 
received  symbol.  An  error-correcting  methodology  that  uses  a  Bayesian  estimate  for  this 
type  of  noise  in  conjunction  with  an  oversampling  assumption  is  derived  in  section  4.  The 
Bayesian  estimate  allows  a  priori  information  to  improve  the  estimate. 
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2.  Timing 


Frame  counters  are  included  within  telemetry  word  tables  and  can  be  used  to  identify  the 
same  frame  across  different  receivers.  Let  c frame  be  an  bit  counter  (usually  the  size  of  a 
word)  that  wraps  to  zero  when  it  overflows.  At  a  sampling  frequency  of  Fg,  the  counter 
repeats  every  2^‘^{1/Fs)  seconds.  Typical  sampling  frequencies  are  ~3  kHz  with  flight 
times  of  ~15  seconds.  Therefore,  the  frame  counter  is  expected  to  overflow  and  wrap  many 
times.  Each  set  of  consecutive  frames  with  Cframe  G  [0,  —  1]  is  called  a  major  frame. 

Because  several  major  frames  are  transmitted  and  “dropouts”  occur,  absolute  time  values 
cannot  be  determined  with  c frame-  A  typical  plot  of  c frame  is  shown  in  hgure  1(a).  Notice 
that  the  received  frame  counter  includes  dropouts  and  erroneous  values. 


Figure  1.  Frame  counter  example:  (a)  Cframe,  (b)  b{n),  (c),  e{n),  and  (d)  hf{n). 

The  hrst  steps  in  using  the  frame  counter  to  determine  the  time  associated  with  a  frame  of 
data  are  to  identify  and  eliminate  errors  with  the  frame  counter.  To  begin,  assume  that  the 
data  are  received  in  the  order  in  which  they  were  transmitted.  In  other  words,  no  frames 
are  out  of  order.  Therefore,  the  correct  form  of  the  frame  counter  is  assumed  to  be 
monotonically  increasing  except  when  it  wraps.  The  increase  between  successive  samples 
may  be  greater  than  one  if  a  dropout  occurs.  Note  that  dropouts  are  capable  of  producing 
any  Cframe  time  series  as  well  as  the  type  assumed  here.  However,  high  signal-to-noise  ratio 
(SNR)  implies  a  low  probability  of  deviation  from  the  assumed  form  of  Cframe-  Also, 
received  data  that  do  not  reflect  the  assumptions  made  here  are  fundamentally  useless.  In 
order  to  detect  errors  in  c frame,  a  simple  transformation  of  the  data  and  a  median 
smoother  are  employed. 
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Let  n  be  a  discrete  time  index  for  the  received  frames  with  0  corresponding  to  the  hrst 
frame,  and  let  b{n)  eqnal  the  difference  between  Cframein)  and  n,  therefore 


b{n)  =  Cframein)  -  U.  (1) 

The  strnctnre  of  b  can  help  identify  errors.  To  see  how,  consider  a  plot  of  b  (hgnre  1(b))  for 
the  frame  connter  in  hgnre  1(a).  Notice  that  single  errors  in  the  frame  connter  are 
transformed  into  impnlses  in  b.  Droponts  prodnce  a  positive  step  whereas  wraps  prodnce  a 
negative  step.  Becanse  of  the  local  monotonicity  of  the  steps,  b  is  invariant  to  a  median 
smoother  with  a  properly  chosen  window  length.  To  see  this,  consider  the  median 
smoother  dehned  as 


y{n)  =  median[a;(n  —  Ni), ...,  x{n), ...,  x{n  +  iVi)].  (2) 

The  median  operation  sorts  the  samples  by  magnitnde  in  the  window  of  length  Nm,  where 
Nm  is  any  positive  odd  integer,  and  selects  the  middle  sample.  The  selection  property  is 
desirable  since  the  only  possible  ontpnt  of  the  smoother  are  nnsigned  integer  valnes.  This 
eliminates  the  need  for  any  reqnantization  of  the  ontpnt.  If  the  samples  in  the  window  are 
monotonically  increasing  or  decreasing,  the  center  sample  in  the  window  is  the  ontpnt  of 
the  smoother.  Therefore,  when  a  window  is  selected  that  is  larger  than  an  error  rnn  and 
smaller  than  time  between  local  steps,  a  median  smoother  will  change  the  error  points 
withont  changing  the  correct  points. 

The  following  algorithm  is  nsed  to  detect  errors  in  the  frame  connter: 

1.  Compnte  b{n),  nsing  eqnation  1. 

2.  Smooth  b{n)  with  a  median  smoother  with  a  properly  chosen  window  length. 

3.  Repeat  step  2  mnltiple  times,  depending  on  the  noise  level. 

4.  Let  bf{n)  be  the  ontpnt  of  the  last  smoother  (see  hgnre  1(d))  and  compnte  the 
difference  e(n)  =  b{n)  —  bf{n). 

5.  An  error  is  expected  to  occnr  in  Cframe{no)  if  e(no)  ^  0. 

The  ontpnt  after  each  smoother  stage  will  be  invariant  to  additional  smoothing  if  it 
consists  only  of  step  fnnctions  that  change  slowly  with  respect  to  the  window  length  of  the 
smoother;  e(n)  conld  also  conceivably  correct  errors  in  c frame-  However,  the  missing  frames 
are  interpolated  instead  since  the  data  are  typically  oversampled.  Fignre  1(c)  shows  the 
error  e(n)  in  the  example. 

Becanse  of  the  ambignity  attribntable  to  mnltiple  wraps  in  the  frame  connter,  additional 
information  mnst  be  nsed  in  order  to  identify  the  same  frame  in  different  sonrces. 
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Fortunately,  most  telemetry  receivers  will  use  a  reference  time  base  such  as  GPS  to  stamp 
each  frame  with  the  time  when  it  was  received,  t^x-  Now  consider  how  t^x  relates  to  the 
actual  time  the  data  in  the  frame  were  acquired,  txx-  Dehne  the  time  difference. 


Ds{n)  =  tRx,s{n)  -  tTx,s{n), 


(3) 


for  each  source,  s,  which  is,  in  general,  a  function  of  the  discrete  time  index  n.  Ds{n) 
depends  on  the  relative  positions  of  the  receiver  and  the  projectile.  Therefore,  different 
times  are  assigned  to  the  same  frame  across  multiple  receivers.  However,  if  the  time  errors 
that  result  satisfy 


Ds{n)  < 


(4) 


for  all  s,  Trx  can  be  used  in  conjunction  with  the  frame  counter  to  identify  the  same  frame 
across  multiple  sources.  Reference  times  for  all  frames  created  in  the  master  are  then 
generated  with  two  parameters,  the  time  of  the  hrst  frame,  t(0)  and  the  sampling  period, 
Ts,  as 

t{n)  =  t(0)  +  nTg.  (5) 


The  parameters  are  computed  as 

^  N  -I  ^  +  1)  “  tRx{n)], 

n£Si 


(6) 


in  which  Si  is  the  set  of  all  indices  so  that  Trx{r  +  1)  and  Trx{r)  exist,  and 

^*^0)  =  ^  -  nTs]. 

neS2 


(7) 


in  which  S2  is  the  set  of  all  indices  so  that  T^xin)  exists. 


3.  Creating  the  Master  Word  Table 


After  a  master  time  base  is  created  and  the  frames  from  each  source  that  correspond  to  the 
time  points  are  identihed,  the  master  word  table  assembly  can  begin.  When  a  frame  of 
data  is  transmitted,  it  is  possible  that  all  or  most  of  the  receivers  receive  the  frame.  With 
the  timing  discussed  in  the  previous  section,  specihc  data  from  each  source  as  representing 
the  same  frame  can  be  identihed. 

Suppose  that  there  are  Ns  sources  with  word  tables  <Fsi,  $*2)  •••)  and  let  ^s{n,w) 
denote  the  wth  word  in  frame  n  from  source  s.  An  empty  master  word  table,  is  now 
created  with  frame  times  that  span  all  the  sources’  times.  The  elements  in  niust  be 
generated  for  each  word  in  each  frame  as  a  function  of  all  the  data  available: 

=  /({$,,,  $,2,. ..,'hsjvs}) 
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First,  note  that  is  it  highly  improbable  for  the  errors  to  produce  the  same  corrupted  word 
in  different  sources.  Therefore,  the  occurrences  of  the  same  word  across  different  sources 
can  be  exploited.  Let  Q{n,w)  denote  the  mode  (element  that  occurs  the  most  often)  or  set 
of  modes  (if  a  unique  mode  does  not  exist)  dehned  as 

Q{n,w)  =mode{^si{n,w),^s2{n,w),...,^SN^{n,w))  (9) 

If  there  is  only  one  mode  ^rn{n,w)  =  Q{n,w)]  otherwise,  an  additional  criterion  must  be 
used  to  choose  from  the  set. 

It  will  be  shown  in  section  4  that  the  transmission  noise  is  impulsive.  As  such,  erroneous 
data  tend  to  be  far  away  in  magnitude  from  their  true  value.  Also,  sensor  output  is 
generally  oversampled,  which  produces  highly  correlated  data.  Thus,  an  erroneous  datum 
tends  to  be  far  away  in  magnitude  from  the  words  in  neighboring  frames.  Therefore,  the 
distance  between  the  word  of  interest  and  its  neighbors  in  different  frames  can  be  exploited 
as  a  criterion  for  choosing  the  master  word. 

Let  dq  be  a  distance  metric  for  each  q  G  Q{n,w);  is  then  dehned  as 

{dg-.  qe  Q{n,k)}.  (10) 

The  square  differences  in  magnitudes  of  neighboring  points  are  used  to  calculate  each 
distance  as 

n+Np 

dq  =  Y^  _  A^s{n,w)  -  ^s{k,w)]‘^  (11) 

s^Sq  k=n—Np 

in  which  Sq  is  the  set  of  sources  in  which  q  occurs  and  Np  is  the  number  of  neighbors  to  each 
side  of  the  current  word.  Np  =  1  provides  good  results  in  high  SNR.  This  step  completes 
the  building  of  the  master  word  table  with  timing  information.  Next,  the  individual  words 
are  hltered  to  eliminate  any  remaining  errors. 


4.  “De-noising”  With  Bayesian  Estimation 


Even  with  multiple  sources  of  word  values,  errors  can  still  be  present  in  the  master. 
Therefore,  we  derive  a  hltering  approach  to  de- noise  the  word  values  by  analyzing  the 
channel  and  methods  that  generated  the  errors.  This  method  is  applicable  when  additional 
information  about  the  data  is  known  a  priori.  The  example  considered  here  is  when  the 
signals  are  over  sampled. 

To  begin,  consider  a  binary  symmetric  channel  (BSC)  so  that  the  output  z{n)  is  dehned  as 

z{ri)  =  x{ri)  ®  y{ri),  (12) 
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in  which  x{n)  G  {0, 1}  is  the  input  sequence  to  the  BSC,  and  y{n)  G  {0, 1}  is  an 
independent  and  identically  distributed  sequence  of  Bernoulli  random  variables  with 
parameter  p  =  pe,  the  bit  error  rate.  The  BSC  models  the  effect  of  the  wireless  channel. 
The  BSC  is  used  to  transmit  unsigned  integer  words  or  symbols  that  are  M  bits  long.  The 
words,  a{n),  are  converted  directly  into  their  binary  representation,  sent  through  the  BSC, 
and  the  output  of  the  BSC  is  converted  back  to  create  the  new  output  sequence,  b{n).  The 
combined  system  is  therefore  a  discrete  memory-less  channel  (DMC)  {3)  that  is  completely 
described  by  a  set  of  conditional  probability  functions.  The  bit  error  rate  of  the  DMC 
causes  the  symbols  to  change.  The  probability  of  receiving  any  b  when  a  symbol  a  is 
transmitted  depends  on  the  hamming  distance  of  a  and  b  dehned  as 

M 

d{a,b)  = (B  f3i  (13) 

ai  and  {3i  are  the  ith  bits  of  a  and  b,  respectively,  and  ©  is  the  Boolean  exclusive  OR  or 
modulo-2  addition.  It  is  possible  to  minimize  errors  using  error-correcting  codes;  however, 
many  telemetry  systems  do  not  employ  coding  because  of  hardware  complexity.  Bit  errors 
produced  from  this  model  result  in  a  very  unusual  conditional  output  probability  density, 
which  is  now  derived. 

Given  that  the  input  symbol  to  the  previously  described  channel  is  a,  the  probability 
density  function  (pdf)  of  the  output,  B,  is 

f{b\a)  =  P{B  =  b\A  =  a)  =  (14) 

in  which  d{a,  b)  is  the  hamming  distance  between  a  and  b.  Since  each  of  the  bits  received  is 
assumed  to  be  independent,  equation  14  follows  from  the  fact  that  d{a,  b)  bits  change,  and 
M  —  d{a,  b)  bits  remain  the  same  in  order  for  the  channel  to  change  a  into  b.  Equation  14 
is  similar  to  a  binomial  distribution,  but  no  counting  term  is  needed  since  only  one  possible 
combination  is  accounted  for.  Figure  2  shows  equation  14  for  an  a  of  2047,  2048,  and  2730, 
Pe  =  0.3,  and  the  number  of  bits  per  word  equal  to  12.  Notice  that  the  densities  are  not 
symmetric  or  semi-monotonic.  The  peaks  or  high  points  correspond  to  errors  in  only  a  few 
bits.  That  error  may  cause  a  large  change  in  the  output  if  the  bit  is  signihcant.  Likewise, 
small  changes  in  the  output  may  require  more  bit  errors  and  are  therefore  not  as  probable. 

If  the  data  source  was  assumed  to  be  memory-less  (i.e.,  each  symbol  generated  is 
independent  of  all  the  other  symbols),  a  maximum  likelihood  estimate  would  be  optimal 
{3).  However,  such  an  estimate  would  not  change  the  received  data  since  no  a  priori 
information  is  used.  Therefore,  a  Bayesian  maximum  a  posteriori  (map)  estimate  approach 
is  considered.  In  order  to  compute  the  joint  pdf  of  a  and  b,  the  a  priori  pdf  of  a  must  be 
determined.  If  the  data  are  oversampled,  the  current  sample  value  should  be  very  close  to 
the  preceding  and  succeeding  sample  values.  Therefore,  the  pdf  of  the  input  sample  can  be 
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Figure  2.  f{b\a)  for  different  a  when  the  number  of  bits  per  word  is  12. 

estimated  as  a  Gaussian  distribution  with  mean, 

fi  =  median[6(?7,  —  Np), h(n  —  1),  h(n),  b{n  +  1),  b{n  +  2), b{n  +  iVp)]  (15) 

in  which  Np  is  the  number  of  points  to  the  left  and  right,  and  variance,  equal  to  a 
constant  that  depends  on  the  amount  of  oversampling.  The  map  estimate  is  dehned  as 

argmax  .  .  . 

a=  ^  f{a\b).  (16) 

In  other  words,  since  the  output,  b,  is  known,  the  best  estimate  of  a  is  the  one  that  is  most 
probable  to  occur  given  b.  Since 

mi)  =  (17) 

and  f{b)  is  not  a  function  of  a,  maximizing  the  numerator  of  equation  17  is  equivalent  to 
equation  16.  Now, 

f{a,b)  =  f{b\a)f{a).  (18) 
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Substituting  equation  14  into  equation  17  and  setting  /(a)  equal  to  a  Gaussian  density 
with  parameters  {ft,  a^)  yields 


f{a,b) 


V2 


:  exp 


(a  —  /t)" 


The  estimate  is  therefore 


a  =  """S (1  -  exp 

a 


(a  - 


(19) 


(20) 


For  implementation  purposes,  the  hrst  two  factors  in  equation  20  are  computed  and  stored 
for  all  possible  values  while  the  exponential  factor  is  computed  at  run  time.  The  estimate 
is  computed  for  each  w).  Figure  3  shows  the  performance  of  the  estimate  for  a  sine 

wave  contaminated  by  the  previously  described  channel  with  pe  =  0.01.  Notice  that  the 
median  smoother  is  successful  in  removing  the  impulsive  noise  but  does  not  correct  to  the 
most  probable  values  as  the  Bayesian  estimate  does. 


Figure  3.  Bayesian  estimation  example  of  a  sine  wave  corrupted  by  noise. 


5.  Performance 


To  demonstrate  the  effectiveness  of  the  algorithms  presented,  a  merger  of  three  source  hies 
is  shown.  Figure  4  plots  an  individual  word  generated  by  a  sensor  for  each  source  and  the 
master.  Notice  that  source  1  has  clean  data  but  contains  large  gaps  in  the  beginning  and 
the  middle.  Source  2  does  not  have  any  large  gaps  but  the  noise  increases  with  time.  The 
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Figure  4.  Word  value  plot  for  source  merging  example:  three  sources. 

data  from  source  3  have  many  small  gaps  and  a  substantial  amount  of  noise,  but  they 
contain  some  frames  not  present  in  sources  1  or  2.  The  algorithm  successfully  merges  all 
three  sources  to  produce  a  continuous  set  of  data  with  no  gaps  and  practically  no  impulse 
noise. 


6.  Conclusion  and  Impact 


The  problems  associated  with  combining  multiple  telemetry  data  sources  have  been 
presented.  The  previous  algorithms  are  currently  employed  in  DFuze  (4)  flight  tests.  The 
proven  methods  result  in  virtually  error-free  master  hies,  despite  substantial  noise  present 
in  the  received  data.  The  algorithms  presented  here  are  completely  general  and  can  be 
applied  to  other  applications  with  multiple  telemetry  receivers. 
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